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Abstract — We propose non-binary LDPC codes concatenated 
with multiplicative repetition codes. By multiplicatively repeating 
the (2,3)-regular non-binary LDPC mother code of rate 1/3, we 
construct rate-compatible codes of lower rates 1/6, 1/9, 1/12, ... . 
Surprisingly, such simple low-rate non-binary LDPC codes out- 
perform the best low-rate binary LDPC codes so far. Moreover, 
we propose the decoding algorithm for the proposed codes, which 
can be decoded with almost the same computational complexity 
as that of the mother code. 

Index Terms — iterative decoding, low-rate code, non-binary 
low-density parity-check code, rate compatible code, repetition 
code 



I. Introduction 

In 1963, Gallager invented low-density parity-check 
(LDPC) codes |j2|. Due to sparsity of the code representation, 
LDPC codes are efficiently decoded by belief propagation (BP) 
decoders. By a powerful optimization method density evo- 
lution fS\, developed by Richardson and Urbanke, messages 
of BP decoding can be statistically evaluated. The optimized 
LDPC codes can approach very close to Shannon limit |4|. 

Rate-adaptability is a desirable property of coding systems. 
Over time-varying channels, the system adapts the coding rate 
according to the quality of the channels. Using the different 
type of codes for different rates results in a complex coding 
system. It is desirable to use a single encoder and decoder 
pair compatible with different rates. Such a property of codes 
is referred to as rate-compatibility. Moreover, rate-compatible 
codes allow us to transmit bits gradually in conjunction with 
automatic repeat request (ARQ). By puncturing a low rate 
code, we can construct rate-compatible codes of higher rates. 

In order to reliably transmit information over the very noisy 
communication channels, one needs to encode the information 
at low coding rate. As described in ||5l, one encounters a 
difficulty when designing low-rate LDPC codes. While, for 
high rate codes, even binary regular LDPC codes have good 
thresholds. The optimized low-rate structured LDPC codes, 
e.g. accumulate repeat accumulate (ARA) code 16] Table. 1] 
of rate 1/6 and multi-edge type LDPC code fS] Table. X] of 
rate 1/10 have good thresholds. However, the maximum row- 
weights of those codes are as high as 1 1 and 28, respectively. 
Such high row weights lead to dense parity-check matrices 
and degraded performance for short code length. We note 
that, with very large code length, generalized LDPC codes 
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with Hadamard codes f7l| perform very close to the ultimate 
Shannon limit |8|. However, the large code length leads to 
transmission latency. If two error correcting codes with the 
same error-correcting capabilities and different code length are 
given, the shorter code is preferred. 

Another obstacle blocking the realization of the low-rate 
LDPC codes is the large number of check node computations. 
For a fixed information length K, it can be easily seen that 
the number M of check nodes gets larger as the coding rate 
R gets lower. To be precise, M = K{1 — R)/R. In the 
BP decoding, computations of check nodes are usually more 
complex than those of variable nodes. It is a desirable property 
for the low-rate LDPC codes to be decoded with computational 
complexity comparable to that of the higher-rate LDPC codes. 

The problems for constructing low-rate LDPC codes are 
summarized as follows. 

• Problem 1: The Tanner graphs of low-rate LDPC codes 
tend to have many check nodes that require more complex 
computations than variable nodes. 

« Problem 2: The Tanner graphs of optimized low-rate 
LDPC codes tend to have check nodes of high degree, 
which results in the degraded decoding performance for 
small code length. 

• Problem 3: The optimized low-rate LDPC codes need to 
be used with large code length to exploit the potential 
decoding performance. 

In this paper, we deal with all these issues. 

In this paper, we consider non-binary LDPC codes defined 
by sparse parity-check matrices over GF(2™) for 2™ > 2. 
Non-binary LDPC codes were invented by Gallager IH. Davey 
and MacKay f9l| found non-binary LDPC codes can outper- 
form binary ones. Non-binary LDPC codes have captured 
much attention recently due to their decoding performance 
flOl, fTT\, fTT\, fT3l, fT4). 

It is known that irregularity of Tanner graphs help improve 
the decoding performance of binary LDPC codes ID. While, 
it is not the case for the non-binary LDPC codes. The (2, k)- 
regular non-binary LDPC codes over GF(2'") are empirically 
known ifTSl as the best performing codes for 2™ > 64, 
especially for short code length. This means that, for designing 
non-binary LDPC codes, one does not need to optimize the 
degree distributions of Tanner graphs, since (2, A:)-regular non- 
binary LDPC codes are best. Furthermore, sparsity of (2, k)- 
regular Tanner graph helps efficient decoding. 

Sassatelli et al. proposed liybrid non-binary LDPC codes 
|16| whose symbols are defined over the Galois fields of 
different sizes, e.g. over GF(2),GF(8), and GF(16) and 
whose Tanner graphs are irregular In other words, the codes 
have two types of irregularity, i.e. irregularity of the degree 
distributions of graphs and the size distributions of Galois 
fields. To the best of the authors' knowledge, the decoding 
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Fig. 1. An example of a mother code Ci. A non-binary (2,3)-regular LDPC 
code of rate 1/3 over GF(2'"). Each variable node represents a symbol in 
GF(2™'). Each check node represents a parity-check equation over GF(2'"). 
The code length is 18 symbols in GF{2'") or equivalently 18m bits. Circle 
and square nodes represent variable and check nodes, respectively. The lower- 
rate codes Ct for T = 2, 3 . . . are constructed from Ci. 



Fig. 2. An example of C2. A non-binary (2,3)-regular LDPC code over 
GF(2'") concatenated with inner multiplicative repetition codes of length 2. 
The code length is 36 symbols or equivalently 36m bits. The rate is 1/6. 



performance of the hybrid non-binary LDPC codes are best 
so far among the low-rate codes of short code length. 

In this paper, we investigate non-binary LDPC codes con- 
catenated with multiplicative repetition inner codes. We use a 
(2, 3)-regular non-binary LDPC code of rate 1/3, as a mother 
code. By multiplicatively repeating the mother code, we con- 
struct codes of lower rates 1/6,1/9,1/12,. . .. Furthermore, we 
present a decoding algorithm for the proposed codes. And we 
show the computational complexity of decoding is almost the 
same as that of the mother code. The codes exhibit surprisingly 
better decoding performance than the best codes so far for 
small and moderate code length. 

The rest of this paper is organized as follows. Section 
defines the proposed codes. Section |III] describes the decoding 
algorithm for the proposed codes. In Section|iy] we investigate 
the thresholds for the proposed codes transmitted over the 
binary erasure channels (BEC) by density evolution 0, ifTTl . 
In Section |V] for the BEC and AWGN channels, we compare 
the decoding performance of the proposed codes and the best 
known codes for short and moderate code length. 

II. Concatenation of Non-Binary LDPC Codes and 
Multiplicative Repetition Codes 

We deal with elements of GF(2'") as non-binary symbols. 
For transmitting over the binary input channels, each non- 
binary symbol in GF(2™) needs to be represented by a 
binary sequence of length m. For each m, we fix a Galois 
field GF(2™) with a primitive element a and its primitive 
polynomial tt. Once a primitive element a of GF(2™) is fixed, 
each symbol is given a m-bit representation IfTSl pp. 110]. 
For example, with a primitive element a S GF(2'^) such that 
TT{a) — + a + 1 = 0, each symbol is represented as 
= (0, 0, 0), 1 = (1, 0, 0), a = (0, 1,0), = (0, 0, 1), = 
(1, 1, 0), = (0, 1, 1), = (1, 1, 1) and = (1,0, 1). 

A non-binary LDPC code C over GF(2™) is defined by the 
null space of a sparse M x N parity-check matrix H = { hij } 
defined over GF(2"). 

C = {.T e GF(2™)^ I iJa; = e GF(2'")^^} 

The c-th parity-check equation for c = 1 , . . . , M is written as 

hcixi + ■■■ + hcNXN = e GF(2'"), 

where /i^i, . . . , /i^jv G GF(2"') and xi, . . . , xjv G GF(2'"). 

Binary LDPC codes are represented by Tanner graphs with 
variable and check nodes [19 pp. 75]. The non-binary LDPC 
codes, in this paper, are also represented by bipartite graphs 



with variable nodes and check nodes, which are also referred 
to as Tanner graphs. For a given sparse parity-check matrix 
H = {hcv} over GF(2'"), the graph is defined as follows. 
The t;-th variable node and c-th check node are connected if 
hcv 7^ 0. By V — 1, . . . , N and c = 1, . . . , M, we also denote 
the v-th variable node and c-th check node, respectively. 

A non-binary LDPC code with a parity-check matrix over 
GF(2™) is called (d^, (ic)-regular if all the columns and all 
the rows of the parity-check matrix have weight dy and dc, 
respectively, or equivalently all the variable and check nodes 
have degree dy and dc, respectively. 

Let Ci be a (2, 3)-regular LDPC code defined over GF(2™) 
of length N symbols or equivalently mN bits and of rate 1/3. 
The code Ci has a 2A^/3 x N sparse parity-check matrix H 
over GF(2™). The matrix H has row weight 3 and column 
weight 2. Fig. [T] shows the Tanner graph of an example Ci of 
length =18 symbols. 

By using Ci as a mother code, we will construct codes 
C2 , C3 , . . . , Ct of lower rates in the following way. Choose 
N coefficients tat+i, . . . , r2Ar uniformly at random from 
GF(2™) \ {0}. The lower-rate code C2 is constructed as 
follows. 

C2 = . . . , X2n)\xn+v = rN+vXy, 

for w = 1, . . . ,iV, {xi,...,xn) e Ci}. 

Since the resulting code C2 has code length 2N and the same 
number of codewords as Ci, then the rate is 1/6. Fig.|2]shows 
the Tanner graph of C2 of length 2N =36 symbols. We say 
that xn+v = TN+vXy is a multiplicative repetition symbol of 
Xy for V — 1,. . . ,N. Each variable node of degree one in 
Fig. |2] represents a multiplicative repetition symbol xjv+i, for 
V ~ 1, . . . , N. And each check node of degree two in Fig. |2] 
represents a parity-check constraint x^v+u + tn+vXv — for 
v=l,...,N. 

For r > 3, in a recursive fashion, by choosing N coeffi- 
cients »'(T-i)7V+ii ■ ■ ■ , fTN randomly chosen from GF(2™) \ 
{0}, the further low-rate code Ct is constructed from Ct-i 
as follows. 

Ct = {(a;i, . . . ,xtn)\x{t-i}n+v = 'r(T-i)N+vXy, 

for V = 1,...,N, {xi, X(^t^i)n) € Ct-i}- 

The code Ct has length TN and rate 1/(3T). Fig. [3] shows 
the Tanner graph of C3 of 3A^ =54 symbol code length. Fig.|4] 
shows the block diagram of the encoding of C3. We refer to 
T as the repetition parameter. 
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Fig. 3. An example of C3. A non-binary (2,3)-regular LDPC code over 
GF(2'" ) concatenated witli one inner multiplicative repetition codes of length 
3. The code length is 54 symbols or equivalently 54m bits. The rate is 1/9. 
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Fig. 4. The block diagram of the encoder of C3. First, source of Af/3 
symbols in GF(2™) are encoded with a (2,3)-regular LDPC code Ci over 
GF(2'"). Next, each symbol in the codeword Xy, for d = l,...,Af, is 
randomly multiplied by rjv+u and r2jv+u from GF(2'") \ {0} to generate 
xm+v and ^2N+v 



Concatenating a binary code with repetition codes is 
known as the worst coding scheme. Indeed, repeating a 
binary code just doubles the number of channel use with- 
out any improvement of the curve of the decoding error 
rate v.s. Eb/Np. Note that the proposed code Ct are not 
generated by simple repetitions of the mother code but 
the random multiplicative repetitions of non-binary symbols. 
Since the coefficient r^+v, ■ ■ ■ , r(^T-i)N+v, G GF(2"') \ {0} 
is randomly chosen, the multiplicative repetition Xv 
{xv,rN+vXv, ■ ■ ■ , r(T-i)N+vXv, ) can be viewed as a random 
code of length mT bits. In other words, the proposed codes can 
be viewed as non-binary LDPC codes over GF(2™) serially 
concatenated with N random binary codes of length mT. 
Intuitively, this explains why multiplicative repetition works 
better than simple repetition. 

The construction of the proposed codes may remind some 
readers of Justesen codes [20|. Note that the proposed con- 
struction chooses the multiplicative coefficients uniformly at 
random. Note also that since the minimum distance of Ci is 
at most 0{\og{N)) ifTSl . the Ct code has minimum distance 
is at most 0{T\og{N)). 

Due to the repetition of symbols, the encoder are inherently 
rate-compatible. 

III. Decoding Scheme 

The BP decoder for non-binary LDPC codes 11211 exchanges 
probability vectors of length 2™, called messages, between 
variable nodes and check nodes, at each iteration round ^ > 0. 
The proposed codes Ct for T > 2 also can be decoded by 
the BP decoding algorithm on the Tanner graphs of Ct- In 
this section, instead of the immediate use of the BP decoding 
on the Tanner graph of Ct, we propose a decoding algorithm 
which uses only the Tanner graph of Ci for decoding Ct for 
T > 2. 

The variable nodes of degree one in Fig. |2] and Fig. [3] 
represent multiplicative repetition symbols of C2 and C3, 
respectively. If the BP decoding algorithm is immediately 
applied to the proposed codes, all the variable nodes and check 
nodes, including the variable nodes of those multiplicative 
repetition symbols, are activated, i.e. exchage the messages. 
However, the messages reaching the variable nodes of degree 
one do not change messages that are sent back from the nodes. 
Therefore, the decoder does not need to pass the messages 
all the way to those variable nodes of degree 1 and their 
adjacent check nodes of degree 2. Consequently, after the 



variable nodes of degree 1 pass the initial messages to the 
upper part of the graph, the decoder uses only the upper part 
of the graph, i.e. Ci. 

The computations of check nodes are more complex than 
those of variable nodes. As posed in the Problem 1 in SectionU 
the number M of the check nodes gets higher as R decreases. 
In general, LDPC codes of information length K and rate 
R have K{1 — R)/R check nodes. In our setting, we have 
K = N/3 information symbols. The number of check nodes in 
the proposed code Ct for T > 2 is also given by K{l — R)/R. 
However, (T — 1)A^ check nodes of degree 2 adjacent to the 
{T~\)N variable nodes of degree 1 do not need to participate 
in the BP decoding iterations. The only 2A^/3 active check 
nodes in the mother code Ci participate in the BP decoding 
algorithm for decoding Ct for T > 2. Note that the number of 
active check nodes 2N/3 remains unchanged for any T > 1. 
This is highly preferable property for low-rate LDPC codes, 
which relieves the Problem 1 . The Problem 2 is also relieved, 
since the maximum degree of check nodes in the mother code 
Ci is as small as 3. 

The BP decoding involves mainly 4 parts, i.e. the ini- 
tialization, the check to variable computation, the variable 
to check computation, and the tentative decision parts. For 
« = NT, let X„ be the random variables with realiza- 

tions x^. Let Ft, be the random variables with realizations y„ 
which is received value from the channel 'PT{Y^\Xy) and the 
probability of transmitted symbol Pr(X„) is assumed to be 
uniform. 

We assume the decoder knows the channel transition prob- 
ability 

Vr{X, = x\Y,=y,),v^l,...,NT (1) 

for X G GF(2™). When the transmissions take place over the 
memoryless binary-input output-symmetric channels, we can 
rewrite ([TJ as 

m 

Pr(X„ = x\Yy = yy) = Pr(X„^i = Xi\Yy^i = yyj), 
1=1 

where {xi, . . . ,Xm) G GF(2)'™ is the binary representation 
of X e GF(2'") and X„ ^ is the random variable of the 
transmitted bit, and the corresponding channel output 2/„ ^ 
and its random variable Yy i. 
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A. Decoding Algorithm 

initialization : 

For each variable node v in Ci for v = 1, . . . ,N, compute 
p^\x) as follows. 

11 P^{XtN+v = rtN+vX\YtN+v = ytN+v), 
t=l 

for X € GF(2™), where ^ is the normalization factor so that 
'^x^Q-p{2m)P'v\x) = 1. Each variable node v — 1,...,N 

in Ci sends the initial message p^c = Pv^^ G to each 
adjacent check node c. Set the iteration round as i :— 0. 

check to variable : 

For each check node c = 1, . . . , M in Ci, let 9c be the set of 
the adjacent variable nodes of c. It holds that #9c = 3, since 
the mother code Ci is (2, 3)-regular Each c has 3 incoming 
messages pi^c for v ^ dc from the 3 adjacent variable nodes. 
The check node c sends the following message pH^^'' G K^"' 
to each adjacent variable node v G dc. 

Pi'K^) ^pi'hK'^) for X e GF(2™), 

pii+'\x) = pii+'\K,x) for X e GF(2™). 

where pi P2 €E K^'" is a convolution of pi G M^"' and 
P2 G • To be precise, 

(pi ®P2){x) - Pi(y)P^(^) for ^ e GF(2™). 

y,2eGF(2'") 

The convolution seems the most complex part of the decoding 
algorithm. Indeed, the convolutions are efficiently calculated 
via FFT and IFFT [22], ifTTl . Increment the iteration round 

as £:^e+l. 

variable to check : 

Each variable node v = 1,...,N in Ci has two adjacent 
check nodes since the mother code Ci is (2, 3)-regular Let 
c and c' be the two adjacent check nodes of v. The message 
Pvc e M sent from v to c is given by 

pi'K^) = ^P^:\^)P':^1{^) for X e GF(2"), 
where ^ is the normalization factor so that 

SxeGF(2"') (x) — 1. 

tentative decision : 

For each v = 1, . . . ,N, the tentatively estimated u-th 
transmitted symbol is given as 

xi^^ = argmax p^^\x)p'£\x)pf,l{x), 

where c and c' are the two adjacent check nodes of If x^^^ := 
{x^i \ . . . , ijv') forms a codeword of Ci, in other words, x^^^ 
satisfies every parity-check equations 

J2 hcvxi''> = e GF(2™) 

vGdc 



for all c = 1, ■ • ■ , M, the decoder outputs x} ' as the estimated 
codeword. Otherwise repeat the latter 3 decoding steps. If the 
iteration round i reaches a pre-determined number, the decoder 
outputs FAIL. 

The decoder is inherently rate-compatible. Indeed, for de- 
coding the different C't of rate 1/(3T) for T = 1, 2, . . . , the 
decoder only needs the Tanner graph of the mother code Ci . 

IV. Erasure Channel Analysis 

In the binary case, we can predict the asymptotic decoding 
performance of LDPC codes transmitted over the general 
memoryless binary-input output-symmetric channels in the 
large code length limit by density evolution (4\. Density evolu- 
tion also can be used to analyze non-binary LDPC codes ||23]| . 
E4\ . However, for large field size, it becomes computationally 
intensive and tractable only for the BEC. 

Rathi and Urbanke developed the density evolution which 
enables the prediction of the decoding performance of the non- 
binary LDPC codes over the BEC in the limit of large code 
length. For a given code ensemble, density evolution gives the 
maximum channel erasure probability at which the decoding 
erasure probability, averaged over all the LDPC codes in 
the ensemble goes to zero. The maximum channel erasure 
probability given by the density evolution is referred to as 
the threshold. 

It is shown in ifTTl that for the transmissions over the 
BEC with non-binai-y LDPC codes defined over GF(2'"), 
the decoding results depend on the binary representation, 
i.e. the primitive element. In other words, two isomorphic 
fields do not, in general, yield the identical decoding results. 
Rathi and Urbanke also observed that the difference of the 
threshold is of the order of 10^"' for the different fields. 
The density evolution IfTTl is developed for the non-binary 
LDPC code ensembles with parity-check matrices defined over 
the general linear group GL(GF(2), rn). In this section, we 
will use the density evolution to evaluate the thresholds of 
non-binary LDPC codes defined over GF(2'"). This is a fair 
approximation, since in |17|, it is reported that the threshold 
for the code ensemble with parity-check matrices defined over 
GF(2™) and GL(GF(2), m) have almost the same thresholds 
within the order of 10^"'. 

When the transmission takes place over the BEC and all- 
zero codeword is assumed to be sent, the messages, described 
by probability vectors {p{x))xeGF{2"^) of length 2™ in general, 
can be reduced to linear subspaces iflTl of GF(2)™. To be 
precise, for each message in the BP decoding algorithm, a 
subset of GF(2)" 

{x e GF(2)'" I p{x) ^ 0}, 

forms a linear subspace of GF(2)'", where x is the binary 
representation of a; e GF(2'"). 

Define = {P^'\ . . . , pj,'J) and = 

{Q\P , . • . , Qm"*) as the probability vectors of length m + 1 
such that Pj (resp. Ql ) is the probability that a message 
sent from variable (resp. check) nodes has dimension i at 
the £-th iteration round of the BP decoding algorithm. The 
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Fig. 5. Thresholds e* of Ct over GF{2™) for the BEC and T=l,2,3 and 5 
from below. The rate is 1/(3T). The straight lines show the Shannon limits 
1 - 1/{3T). 



density evolution gives us the update equations of and 
g(^) for ^ > 0. 

Rathi and Urbanke lfTTl developed the density evolution 
for the BEC that tracks probability mass functions of the 
dimension of the linear subspaces. For £ > 0, the density 
evolution tracks the probability vectors P'^^ and Q^^^ which 
are referred to as densities. The initial messages in (|2|i can 
be seen as the intersection of T subspaces of the messages 
received as the channel outputs. The density of the initial 
messages is given by as follows. 



p(0) 

E := 
E, 



T times 



, E„ 



where e is the channel erasure probability of the BEC. The 
operator □ is defined as follows. 

m k+m—i 

[PBQ]^=Y, E Ca{m,k,t,j)PiQ„ 

i—k j—k 
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—, r is a 2-Gaussian binomial. 
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Since the mother code is (2,3)-regular, the update equations 
of density evolution is given by 
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Fig. 6. The asymptotic decoding performance over the BEC of the proposed 
codes and the best known low-rate codes. One curve corresponds to the 
proposed code Ct over GF{2^) of coding rates R = 1/(3T) with repetition 
parameter T = 1, . . . , 10. The punctured Ci of rate 1/2 is also plotted. The 
other curve corresponds to the bit-wise shortened non-binary LDPC code 
over GF(2^) proposed by Kline et al. (25j Fig. 1]. The vertical axis indicates 
(1 — e* — R)/R which is the normalized gap between the capacity 1 — e* 
and the rate R, where e* is the threshold. 



where the operator Kl is defined as follows. 

fe k 



i=0 j=k—i 



Since the messages of dimension corresponds to the suc- 
cessful decoding, the threshold is defined as follows. 
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In the large code length limit, if e < e* the reliable transmis- 
sions are possible with the proposed Ct- 

Fig. |5] draws the thresholds of Ct defined with parity- 
check matrices over GL„i(GF(2)) for repetition parameter 
T = 1, . . . , 5 and m 1, . . . , 10. The threshold e* = 1/ \/2 
for the binary case m = 1 is decided by the stability condition 
lfT91 . It can be seen that the thresholds are not monotonic with 
respect to m. For repetition parameter T = 1, i.e., the mother 
code has the maximal threshold at to = 6. For T > 2, the 
maximal threshold is attained around at to = 8. 

Fig. |6] compares the proposed codes and the best existing 
low-rate LDPC codes respect to the thresholds for the BEC. 
It can be seen that the proposed codes have better thresholds 
especially for lower rates. 

V. Numerical Results 

In this section, we give some numerical results of the 
proposed codes. Fig. |7] shows the decoding performance of 
the proposed code C2 whose mother code is a (2, 4)-regular 
non-binary LDPC code defined over GF(2*). The transmission 
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Fig. 7. The solid curve shows the decoding performance of the proposed 
code C2 whose mother code is a (2, 4)-regular non-binary LDPC code defined 
over GF(2*). The coding rate is 1/4. The transmission takes place over the 
BEC. The arrow indicates the threshold 0.72898 of C2. The code length is of 
length 1024, 8192 and 65536. For comparison, the decoding performance of 
accumulated LDPC (ALDPC) codes |26 Fig. 15] is shown. It is known that 
the ALDPC codes achieve the capacity of the BEC in the limit of large code 
length and exhibit good decoding performance with finite code length. The 
frame error rate of corresponding random codes of rate 1/4 under maximum- 
likelihood decoding are calculated by |27 Eq. (3.2)]. It can be seen that the 
proposed codes exhibit better decoding performance than the ALDPC codes 
with code length up to 8192. The error floors of the proposed codes can not 
be observed down to FER 10~^ while the ALDPC codes have high eiTor 
floors even with code length as long as 65536 bits. 
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Fig. 9. Frame enor rate versus parameter for the proposed codes C2 and C7 
over GF(2*) transmitting over the AWGN channel. The rates of C2 and C7 
are 1/6 and 1/21, respectively. The information length are set to 1024, 4096, 
16834, and 65536. The arrows indicate the corresponding threshold values. 
Observe how the curves move closer to these threshold values for increasing 
codeword lengths. 



SP59R=1/3,1/6.1/18 
Punctured C, R=l/2 
C, R=l/3 
C2 R=l/6 
R=l/I8 
Hybrid R=l/6 




10 

Repetition parameter T 



20 



Fig. 10. The frame error rate of the proposed codes Ct for T = 1, 2, 6 and 
hybrid non-binary LDPC codes. It also shows the performance of rate half 
punctured mother code C'l. All these codes have 192 information bits. The 
curves labeled SP59 are the coiresponding Shannon's 1959 sphere-packing 
bound (281, |29|, 1301 for rate 1/3, 1/6 and 1/18. 



Fig. 8. The thresholds for the AWGN channels of the proposed codes Ct 
of rate l/(3r) for T = 1, . . . , 20. The codes are defined over GF(2'*). 



takes place over the BEC. The compared accumulated LDPC 
(ALDPC) codes are designed to achieve the capacity in the 
limit of large code length. It can be seen that the proposed 
codes exhibit better decoding performance than the ALDPC 
codes with code length up to 8192. The error floors of the 
proposed codes can not be observed down to frame error rate 
10~^ while the ALDPC codes have high error floors even with 
code length as long as 65536 bits. 

Fig. |8] shows the thresholds of the proposed codes Ct 
of rate l/(3r) for T = 1,...,20. The codes are defined 
over GF(2*). The threshold values are calculated by the 



Monte Carlo simulation method. The method was originally 
suggested in lISTl p. 22] and an efficient calculation was 
developed in ll32l Section VII]. It can be observed that the 
proposed codes leave a gap to the ultimate Shannon limit 
Eb/No = logio(ln(2)) « -1.59 [dB] fS] even in the limit 
of large repetition parameter T. Fig. |9] depicts the simulation 
results for the AWGN channels of C2 and C7 of very long code 
length. We observe the convergence to a sharp threshold effect 
at the predicted threshold values as the information length k 
increases. 

We demonstrate the decoding performance of the short 
and moderate-length proposed codes Ct for T = 1,2, 3, 4, 6 
over the binary-input AWGN channels. The mother code 
Ci is constructed by the optimization method in ||T5|. The 
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Fig. 11. The frame error rate of the proposed codes Ct for T = 1, 2, 6, 
multi-edge type (MET) LDPC code of rate 1/2 (5] and 1/6, and accumulate 
repeat accumulate (ARA) code |6| of rate 1/6. All these codes have 1024 
information bits except that the MET LDPC code of rate 1/2 has 1280 
information bits. It also shows the peii'ormance of rate half punctured mother 
code C'l. The curves labeled SP59 are the corresponding Shannon's 1959 
sphere-packing bounds for rate 1/3, 1/6 and 1/18. 



coefficients r^r+i, . . . ,rTN are chosen uniformly at random 
from GF(2™)\{0, 1}, where 1 G GF(2™) is the multiplicative 
identity. We fix to = 8 for its good performance and the 
computer-friendly representation of byte. 

Fig. [To] shows the decoding performance of Ct for T = 
1,2,3,6 of rates 1/(3T). It also shows a hybrid non-binary 
LDPC code [16J of rate 1/6 and punctured Ci of rate 1/2. All 
these codes have 192 information bits. The proposed code C2 
outperforms the hybrid non-binary LDPC code which is the 
best code so far for that rate and code length. The code C3 
of rate 1/9 has about 0.5 [dB] coding gain from C2 of rate 
1/6. As we show on these curves, the proposed construction, 
although simple, allows to design codes with very low rates 
without large loss of gap to the Shannon limits. 

The same property can be seen for the proposed codes 
with larger information bits. Fig. [TT] shows the decoding 
performance of Ct for T — 1,2,3,6, the binary multi-edge 
type LDPC code of rate 1/2 and 1/6, and the binary ARA 
code |6| of rate 1/6. All these codes have 1024 information 
bits except that the MET LDPC code of rate 1/2 has 1280 
information bits. It also shows the performance of a punctured 
mother code Ci of rate 1/2. Among the codes of rate 1/6, the 
proposed code C2 has the best performance both at water-fall 
and error-floor regions. 

As posed in Problem 3, conventional low-rate codes re- 
quired large code length to exploit the potential performance. 
It can be seen that the proposed codes exhibit better decoding 
performance both at small and moderate code length. 

VI. Conclusions 

We propose non-binary LDPC codes concatenated with 
inner multiplicative repetition codes. The performance of the 
proposed codes exceeds the hybrid non-binary codes, multi- 
edge type LDPC codes and ARA codes both at the water-fall 



and error-floor regions. The encoder and decoder are inher- 
ently rate-compatible, and especially the decoder complexity 
is almost the same as the mother code. 
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